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Abstract —Enabling coordination between products from dif¬ 
ferent vendors is a key characteristic of the design philosophy 
behind future wireless communication networks. As an example, 
different devices may have different implementations, leading to 
different user experiences. A similar story emerges when devices 
running different physical and link layer protocols share frequen¬ 
cies in the same spectrum in order to maximize the system-wide 
spectral efficiency. In such situations, coordinating multiple inter¬ 
fering devices presents a significant chailenge not oniy from an in¬ 
terworking perspective (as a result of reduced infrastructure), but 
also from an implementation point of view. The following question 
may then naturally arise: How to accommodate integrating such 
heterogeneous wireless devices seamlessly? One approach is to 
coordinate the spectrum in a centralized manner. However, the 
desired autonomous feature of future wireless systems makes 
the use of a central authority for spectrum management less 
appealing. Alternately, intelligent spectrum coordination have 
spurred great interest and excitement in the recent years. This 
paper presents a multi-level (hierarchical) power control game 
where users jointly choose their channel control and power 
control selfishly in order to maximize their individual energy 
efficiency. By hierarchicai, we mean that some users’ decision 
priority is higher/iower than the others. We propose two simple 
and nearly-optimal algorithms that ensure complete spectrum 
coordination among users. Interestingly, it turns out that the 
complexity of the two proposed algorithms is, in the worst case, 
quadratic in the number of users, whereas the complexity of 
the optimal solution (obtained through exhaustive search) is 
N\. These results offer hope that such simple and accurate 
power control algorithms can be designed around competition, 
as hierarchical behavior does not only improve the mechanism’s 
performance but also leads to simpler distributed power control 
algorithms. 

Index Terms —Spectrum coordination, multi-carrier networks, 
multi-level system, energy efficiency, power control game. 

I. Introduction 

Operators are facing exponential traffic increase in their 
newly deployed networks, which is becoming a challenge in 
terms of investments and energy consumption QJ, j2j. Since 
2010, under the GreenTouch consortium initiative J3j7cellular 
network actors have identified different solutions and scenarios 
of future networks that could sustain the expected traffic 
huge demand while maintaining a good quality of service 
(QoS) and reducing environmental impact. As an example, the 
ambitious mission of the GreenTouch consortium initiative is 
to deliver the architecture, specifications and roadmap in order 
to increase total network energy efficiency by a factor of 1000 


compared to 2010 levels 0 . Whether these solutions are based 
on optimizing the macro layer, using new frequency bands or 
introducing small cells, they all require a careful study in terms 
of energy consumption impact and operational costs. 

In future networks such as heterogeneous networks, 
interference management is a crucial issue since the 
interference due to spectrum sharing can significantly degrade 
the overall performance 0 - In the existing works, various 
resource allocation methods are proposed to either improve 
energy efficiency or alleviate interference. However, very little 
research has addressed their joint interaction. Furthermore, 
most existing works are throughput-based-utility problems 
which lead to a water-filling power control |[5j where only 
a certain number of carriers are exploited depending on the 
channel gains. In particular, when the signal-to-noise plus 
interference ratio (SINR) is low (resp. high), only one (resp. 
every) carrier is exploited. Energy efficiency, on the other 
hand, is always maximized by using a single carrier |6j. This 
means that an energy efficient transmitter ( e.g ., a primary 
user) always leaves K — 1 bands completely vacant for other 
users (e.g., secondary users) with K being the total number 
of carriers. This makes the coordination feature across the 
multiple interfering devices particularly appealing, not only 
from an interworking perspective (as a result of reduced 
infrastructure), but also for improving both network coverage 
and capacity without the need to split the available spectrum. 
As an example, in heterogeneous networks, the coordination 
between macro cells and small cells can increase capacity 
in the order of 2 to 10 times through spectrum reuse across 
layers and radio coordination functionality [7j. The practical 
performance of spectrum coordination is, however, limited 
by a variety of nonidealities, such as insufficient channel 
knowledge, high computational complexity, heterogeneous 
user conditions, transceiver impairments, and the constrained 
level of coordination between users. 

One major motivation of this paper is to study fully coordi¬ 
nated energy efficient models which can be easily implemented 
in practice. A key technical mechanism of multi-user resource 
allocation is that of power control, which serves as a mean 
for both battery saving and interference management. We shall 
address a multi-level (hierarchical) power control game where 
transmitters choose their control policy selfishly in order to 
maximize their individual energy efficiency. We shall further 
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Fig. L The original model in |[l8j and the new model. 


model the system as a decentralized multiple access scheme 
in the sense that the receiver does not dictate to the users their 
transmit power levels. Hence, each user can choose freely 
his power control policy in order to selfishly maximize his 
individual performance criterion, called utility (or payoff) in 
the context of game theoretic studies. 


Related Work 


There have been many works on hierarchical (Stackelberg) 
games, even in the context of cognitive radio |8j, but they 
do not consider energy efficiency for the individual utility as 
defined in They rather consider transmission 

rate-type utilities (see e.g., ITT], for water-filling games, 
m for pricing models, fT4) for coalition formation games). 
Hierarchical games are in fact a mechanism for wireless net¬ 
works in which some wireless nodes (leaders) have the priority 
to access the medium, whereas other users (followers) have a 
low priority to transmit. In the literature, energy efficient power 
control game has been first proposed by Goodman et al. in 
[0 for flat fading channels and re-used by [6j and 1151 for 
multi-carrier code-division multiple access (CDMA) systems, 
m for relay-assisted DS/CDMA and G3 for orthogonal 
frequency-division multiple access (OFDMA) communication 
systems. All these works did not consider hierarchy among 
different actors in the system. 


In (19), authors studied a hierarchical game theoretic model 
for two-user two-carrier energy efficient wireless systems. The 
power control problem is modeled as a Stackelberg game 
where transmitters choose their control policy selfishly in order 
to maximize their individual energy efficiency. Interestingly, 
it was shown that, under some assumptions, introducing a 
certain degree of hierarchy in a multi-carrier system results in 
a coordination game where the user with the higher priority 
( i.e ., the leader) and the user with the lower priority (i.e., the 
follower) have incentive to choose their transmitting carriers in 
such a way that they always transmit on orthogonal channels. 


More specifically, we propose two nearly-optimal though 
low complex algorithms to achieve spectrum coordination at 
the equilibrium of the hierarchical game, namely: 

• The <5-Optimal Complete Spectrum Coordination Algo¬ 
rithm (ci-OCSC Algorithm) where hierarchy is introduced 
exogenously, e.g., through the order of joining the net¬ 
work, 

• The (5-Modificd Complete Spectrum Coordination Algo¬ 
rithm (d-MCSC Algorithm) where hierarchy is introduced 
to minimize the distance from the equilibrium based on 
already known channel gains. 

The main rationale behind the proposed algorithms is that 
if each entering player maximizes his payoff using all the 
carriers, he may (and often will) degrade the utility of the 
players before him. Assuming, that each player chooses only 
from the carriers left idle by his predecessors, we obtain a 
number of profits: 

• no utility degradation by the players joining the game 
later. In other words, the players profit from being leaders, 
and thus will not change their decisions after others will 
join the game, 

• each player knows his final utility when he makes his 
decision. He does not need to know neither how many 
players will come after him, nor their channel quality. 

Under this setting, for a large number of players, instead 
of using a complicated, and not necessarily convergent 
algorithms like the one of Meshkati et al. [|6j, it is reasonable 
to use the proposed fast and simple algorithms, as in a vast 
majority of cases it also gives an exact equilibrium solution. 
These outcomes are meaningful to many practical scenarios. 
Indeed, it is easy to see that this hierarchy concept can be 
directly applied to any network in which users access to 
the medium in an asynchronous manner by employing a 
listen-before-talk mechanism such as cognitive radio networks 
(with the primary user as the leader and secondary users 
as followers). This is also a natural setting for (multi-tier) 
heterogeneous wireless networks due to the absence of 
coordination among the small cells, and between small cells 
and macro cells (2D), (21). 


In the light of the above, the paper is structured as follows. 


The general system model is provided in Sec. II-A 


Sec. II-B 


defines the energy efficiency framework and Sec. Ill presents 
the game theoretic formulation. Then, in Sec. IV we present 
the two proposed algorithms to achieve complete spectmm 
coordination at the equilibrium. Sec. [V] provide numerical 
results to illustrate and validate the theoretical results derived 
in the previous sections. Additional comments and conclusions 


are provided in Sec. VI 


II. System Model and Problem Statement 
A. System Model and Notations 

Consider a decentralized multiple access channel with an 
arbitrary number of users N enjoying a slotted bandwidth of I\ 














carriers. We assume that the system has N levels of hierarchy, 
i.e., one user per level as follows: the super leader (player with 
the highest priority) is assigned with level index 1 , and the last 
follower (player with the lowest priority) is assigned with level 
index N. Accordingly, interference experienced by user n for 
n = {2,..., N} results from the upper levels’ transmissions, 
i.e., users m G {1,..., n — 1}. It follows then that, for any 
user n G {1,..., N}, the received SINR is expressed as 

n k n k ~ 

In = ^ - : =Pn h n (D 

a2 + Y. 

m = 1 

We will call h * the effective channel gain defined as the 
ratio between the SINR and the transmission power for the 
users over the k th carrier. g k and p k are resp. the fading 
channel gain and the power control of user n transmitting 
on carrier k, whereas cr 2 is the variance of Gaussian noise. 
For realistic reasons and since we try to obtain a complete 
spectrum coordination, we will further assume that K > N. 


B. Network energy efficiency analysis 

Our system model is based on the seminal paper |9| that 
defines the energy efficiency framework. To pose the power 
control problem as a game, we first need to define a utility 
function suitable for data applications. SINR is a critical 
parameter for the QoS of the signal transmission, as it directly 
determines the bit error rate, which is closely related to the 
data throughput (average rate of successful packet delivery). In 
brief, when SINR is very low, data transmission results in mas¬ 
sive errors and the throughput tends to 0; when SINR is very 
high, data transmission becomes error-free and the throughput 
grows asymptotically to a constant. However, achieving a 
high SINR level requires the user terminal to transmit at a 
high power, which in turn results in low battery life. This 
phenomenon can be concisely captured by an increasing, 
continuous and S-shaped ’’efficiency” function /(•), which 
measures the packet success rate. Therefore, the throughput 
of user n over carrier k can be expressed as 

T n = Rn ■ fhn) ( 2 ) 

where R n stands for the transmission rate of user n and j k 
stands for the transmission rate and the SINR of user n over 
carrier k. We also require that to ensure that the utility is equal 
to 0 when p n = 0. On the other hand, increasing the transmit 
power clearly favors the packet success rate and therefore 
the throughput. However, as the packet success rate tends to 
one, further increasing the power can lead to marginal gains 
in terms of throughput regarding the amount of extra power 
used. The following utility function allows one to measure the 
corresponding trade-off between the transmission benefit (total 
throughput over the K carriers) and cost (total power over the 


I\ carriers): 

K 

Rn-J^f^n) 

U n ( Pl,.--,Pn) = - Y 1 - O) 

k =1 

where p n is the power control vector of user n over all 
carriers, i.e., p n = (pff,... ,p^). The utility function u n 
that has bits per joule as units perfectly captures the trade¬ 
off between throughput and battery life and is particularly 
suitable for applications where energy efficiency is crucial. It 
should be noted that the throughput in ([2| could be replaced 
with any increasing concave function as long as we make 
sure that ..., 0) = 0. It can be shown that, for a 

sigmoidal efficiency function, the utility function in pi) is a 
quasi-concave function of the user’s transmit power (22], and 
we will use this assumption throughout our paper. This is also 
true if the throughput in ([2| is replaced with an increasing 
concave function of y k . 

III. The multi-level game theoretic formulation 

We consider a multi-level game framework in which the 
leader (referred to hereafter as user 1) decides first his power 
control vector pi and based on this value, the followers (re¬ 
ferred to hereafter as user n for n = 2,..., N) will adapt their 
power control vectors p n in a sequential way depending on 
their level of hierarchy according to the following optimization 
problem 

Pn (Pi > * * * j Pn) = argmaxu n (pi,..., p n ) (4) 

Pn 


To characterize the solution of the above problem in a 
multi-level system, we shall first look at the last follower 
(user N) who makes the first move to decide his transmit 
power. An equilibrium can thus be determined using a multi¬ 
level approach, where, given the action of higher users in 
the hierarchy, we compute the best-response function of the 
follower (the function p n (-) for n = 2 ,..., N) and find the 
actions of the followers which maximize their utilities. We 
characterize this best-response function by using a result from 

©■ 

This result comes directly from Proposition 1 of ( 6 ]| which 
we adapt for the multi-level hierarchical game. 

Proposition 1. Given the power control vector pi,..., p n i 
of the first n— 1 players in the hierarchy, the best-response of 
the player n (for n G {2,..., N}) is given by 


—k 

Pn = 


* / 2 I 
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fork = L n ( pi,.. • ,Pn-i), 
for all k ^ L„(pi,..., p n -i) 

(5) 


with L n ( pi,... ,p n -i) = argmax/i£(pi,... .p n -i) and 7 * 

k 

is the unique (positive) solution of the first order equation 


xf'(x) = f(x). 


( 6 ) 





Equation (0 has a unique solution if the efficiency 
function /(•) is sigmoidal | )22| . The last proposition says 
that the best-response of the follower is to use only one 
carrier, the one such that the effective channel gain is the best. 

One could wonder why not let each player choose its power 
allocation strategy according to Proposition |T|? The response 
is that, if a user had all the data, in order to profit from being 
the leader in that case, he would have to make very complex 
computations, whose complexity would grow exponentially 
with the number of remaining players. To overcome these 
computational challenges among others, we present, in the 
next section, two simple nearly-optimal algorithms to obtain 
complete spectrum coordination among users. 

IV. Proposed Spectrum Coordination Algorithms 

In this section, we will show that using a simple procedure 
combined with a well chosen hierarchy among the players, we 
may obtain both a complete spectrum coordination and payoffs 
not far from the optimum for each of the players. This can be 
achieved in two different scenarios. In a way, considering a 
centralized mode where the proposed system would require in¬ 
formation from a third party (i.e., central database maintained 
by regulator or another authorized entity) to schedule users 
coming. In another way, an extra signaling channel is dedicated 
to perform the collision detection so that users will not transmit 
at the same moment. Such an assumption could be justified by 
the fact that in an asynchronous context, the probability that 
two users decide to transmit at the same moment is negligible 
as the number of users is limited. 

We start by defining a naive mechanisrrQ for determining 
the power control for all the players. Let 7 r be an arbitrary 
ordering (permutation) of the players. 

Algorithm 1. 7r -Complete Spectrum Coordination Algorithm 
(it-CSC Algorithm) 

For n = 1,..., N do the following steps: 

1) For player n(n), choose the carrier with the highest 
9n( n ) ^at is not already chosen by some other player. 
Denote it by n(n). 

2) Choose the following power control for player 7 r(n): 

7 fc a , when k = n(n) 

9 *(») 

0 , otherwise 

The proposition below gives some important features of this 
algorithm. To present it, we need to introduce some additional 
notations. For each player n and every carrier k define p k n = 

k 

where B n is the best channel for player n. This fraction 

can be interpreted as loss of quality ratio of player n from 
choosing carrier k instead of his best carrier (note that if we 
assume that each of the players uses different carrier, as we 
do here, their optimal utilities on their chosen carriers will be 

1 As we will see later in the paper. Algorithm 1 is just a starting point for 
Algorithms 2-4. 


^ f 2 Rn , which is proportional to g k ). Next for each n and 
l = 1,..., K let Pn{l) be the Z-th biggest value of p^. 

Proposition 2. If there exists an a such that, for n = 
1 ,... ,N, p^^n) {n) > a, then the ir-CSC Algorithm gives each 
user the utility not smaller than a times the biggest utility that 
he can obtaii\p\ 

The proof of Prop. [2] is given in Appendix [A] Two imme¬ 
diate consequences of this proposition are the following: 

Corollary 1 . If a satisfies the assumptions of Proposition [2] 
then the power control defined by the n-CSC Algorithm are a 
—equilibrium in our power control game. 

Corollary 2. If a satisfies the assumptions of Proposition [2] 
then the optimal solution of our game when they use power 
control defined by the n-CSC Algorithm, is not smaller than 
a times the optimal solution at the social optimum. 

As we can see, even this simple control mechanism pos¬ 
sesses some useful characteristics. It can notably be applied 
in case the hierarchy is introduced exogenously, such as in 
asynchronous systems where the probability that two users 
decide to transmit at the same moment is negligible, provided 
that the number of users is limited. 

A. The S-Optimal Complete Spectrum Coordination Algorithm 
(5-OCSC Algorithm) 

If we can impose hierarchy between the players in order 
to improve the performance of the mechanism, we may use 
the algorithm defined below. Its main goal will be to find the 
hierarchy of the players 7 r minimizing a (and in consequence 
giving the solution closest both to the equilibrium and the 
social optimum in our game). A small value S > 0 is the 
parameter of the algorithm. 

Algorithm 2. Start with a = 0, a = 1, a* = 0 and n* = 
[1 • ■ • N}. 

Repeat the following steps until the procedure is interrupted 
in point 1): 

1) Ifa — a < S or a > r stop. Otherwise take a* = 

and n = 0 lx x- 

2) For n = 1,..., N do the following steps: 

Find the smallest p„(Z*) such that p n {l*) > a*. If 
7 r(Z*) = 0 then put 7 r(Z*) = n. Otherwise, find the 
biggest l < l* such that 7 r(Z) = 0, and put i r(Z) = n. 
If 7 r (Z) 0 for every positive l < l* put a = a* and 
return to point 1). 

3) Put 7 r* = 7 r with all the zero elements removed, a = a* 
and return to point 1). 

Now, we can state Algorithm 3. 

-By the biggest utility a player can obtain we mean utility that he obtains 
when all the players cooperate to maximize his utility. It bounds from above 
both his utility at equilibrium and at the social optimum. 





Algorithm 3. 5-Optimal Complete Spectrum Coordination 
Algorithm (S-OCSC Algorithm) 

1) Compute the values of p n (l). 

2) Perform Algorithm j2jfor S and p„((). 

3) If the output 7 r* = 0, put a* = 0 and n* = [1... N], 
Then for the output tt* perform n*-CSC Algorithm. 

Given the interpretation of p„, the parameter a appearing 
in algorithms above can be interpreted as the maximal loss 
of utility for any player from not being the leader, that is 
the worst-cas^] ratio of utility of any of the players who do 
not choose their carriers first to their utility if they were the 
first ones to choose. The objective of Algorithm [2] is to find 
the ordering of the players which minimizes this disutility. It 
is done by putting on i-th coordinate of ordering 7r a player 
(his index), who has at least i good carriers to choose from 
(by which we mean i carriers with utility better than a times 
his best possible utility if he was a leader), a* obtained by 
Algorithm [2] is the minimum value for which such an ordering 
is possible. As a consequence, the outcome of the 5-OCSC 
Algorithm will have several useful properties. 

Proposition 3. The choice of power control done by the 5- 
OCSC Algorithm satisfy the following: 

1) It gives each of the players the utility not smaller than 
a* times the biggest utility that he can obtain. 

2) It is a — equilibrium in the game. 

3) The optimal solution in our game when they use power 
control defined by it is not smaller than a* times the 
optimal solution at the social optimum. 

A) If a* > then the power control given by the 

outcome of the algorithm is an equilibrium of the game. 
Moreover, for S small enough there exist the values g^ giving 
the same values of p n (l) as g„ such that the power control 
obtained by the S-OCSC Algorithm for the game with channel 
gains equal to g ^ are the best e-equilibrium with complete 
spectrum coordination. 

The proof of Prop. [3] is given in Appendix [B] We need to 
know that Proposition pldoes not give exact information about 
the quality of the algorithm proposed, just an upper bound 
which may be far from exact. Especially, when N <C K, the 
bounds on the quality of the solution obtained can be far 
from reality. In fact, the solution obtained then may either 
be an equilibrium (or very close to it, even if a* is smaller 
than yq^r) or almost 1 ~ f ,* away from equilibrium, even 
though there exists one in the game. Anyway, as the last part 
of the proposition states, the S-OCSC Algorithm is the best 
algorithm for choosing the power control of the players, in a 
certain class. This class consists of the algorithms inducing 
complete spectrum coordination, and such that the ordering of 
the players is completely done before the power control starts. 


Remark 1. It is worth noting here that, in case N -C K, a 
simpler algorithm may give comparable expected utilities to 
players: instead of finding optimal ordering of the players, we 
may randomize it. This approach has however two important 
disadvantages. First, even when N is small in comparison 
to K , with some small probability a very bad ordering may 
be obtained, which is not possible in 5-OCSC Algorithm. 
Second, in general it may happen (and the probability of 
such a situation grows as N approaches K ) that the output 
of Algorithm [3] will be optimal in any meaningful sense, 
while randomization of the ordering of the players followed 
by Algorithm |T| will give with probability close to 1 utility 
close to 0 for some players. An example of such situation is 
the following: let 


J 1 — ke, k < n, 

\ (K — k)e, k > n 


for some small value of e > 0. The optimal ordering of the 
players here is 1,2,... ,n, with power allocations chosen by 
the 5-OCSC Algorithm giving each of the players not less 
than 1 — ns times his maximum utility. On the other hand, 
when K = N, any other ordering will give at least one player 
no more than I\e times his maximum utility, which can be 
arbitrarily small for appropriately chosen e. We will further 
discuss this issue in Section [V] by comparing our approach to 
a random coordination algorithm. 


B. The 5-Modified Complete Spectrum Coordination Algo¬ 
rithm (S-MCSC Algorithm) 

To go further with the analysis, and with the same goal of 
obtaining a better energy efficiency at the equilibrium, we will 
need an algorithm which updates the ordering of the players 
after each power control is made. Such a modification should 
be most effective exactly in case N <C K, when most of the 
desired power control (that is, the ones giving the players the 
highest utilities possible) will not interfere with each other, as 
5-OCSC Algorithm tries to provide the best ordering in case 
most of the desired choices do interfere. The pseudo-code for 
the proposed approach is given in the next algorithm. 

Algorithm 4 . 8-Modified Complete Spectrum Coordination 
Algorithm (5-MCSC Algorithm) 

Compute the values of pjj. Define the sets of indices S = 
{1,..., N} and S = {1,..., K}. For n = 1,..., N do the 
following steps: 

1) For the set of players reduced to S and set of carriers 

reduced to S update perform Algorithm [5] 

for S and p n (l)- 

2) For the output 7r* (1) choose the carrier k £ S with the 
highest g*,(iy Denote it by n. 


3 Worst-case here means that such a big disutility will only be perceived 

by the players if their private ordering (from best to worst) of the carriers is 4 But without updating the values of p^, just reducing the sets of indices 
similar, e.g. when channel gains for different users are strongly correlated. n and k. 






3) Choose the following power control for player 7r*(l): 


0.9 


P^i 1) 


7 a 

Q k 

^*( 1 ) 


when k = k 
otherwise 


4) Change the sets S and S according to: S := 5'\{7r*(l)}, 
S ■= S\{n}. 

In fact, hierarchy between decisions players can be 
introduced here in order to minimize the gap between the 
output of the proposed algorithms and the equilibrium (based 
on already known channel gains). We do not present any 
formal proposition on the quality of the solution obtained, 
as all the results of the Proposition [3] still hold for this 
modification of the algorithm, while in general no better 
boundaries can be obtained, as the differences between the 
two algorithms depend strongly on the relation between N 
and K. 


Remark 2. Being higher in hierarchy is, unlike (23) , profitable 
for the players. It is straightforward to see that in Algorithm[T|a 
player higher in hierarchy has more options to choose from, so 
he can never lose on it. On the other hand, in Algorithms [3] and 
[4] the hierarchy is chosen to get solution of the game as close 
to the equilibrium as possible. Consequently, if one of these 
algorithms finds an exact equilibrium (we will see in the next 
section that, for the vast majority of cases, we obtain an exact 
equilibrium solution) a player trying to violate the ordering 
introduced by the algorithm by going up the hierarchy may 
lose on it, as this may move the game out of the equilibrium, 
and responses of other players may degrade the deviator’s 
performance. 


V. Simulation Results 

We consider the widely used energy efficiency function in 
power control games, that is f(x) = (1 — e~ x ) M , where 
M = 100 is the block length in bits. For this efficiency 
function, 7* ~ 6.47 (or 8.1 dB). Note that we have sim¬ 
ulated 10000 scenarios to remove the random effects from 
the Rayleigh fading channels g\ Jj. We have considered that 
SNR = \ and that the rate of each user n is R n = 1 
Mbps. Unless otherwise stated, we fix the number of carriers 
K to the number of users N. 

Figure [ 2 ] depicts the probability that a >= 1/(1 + 7*) 
which, as part 4) of Proposition [3] claims, guarantees that the 
power control given by the outcome of the algorithm <5-OCSC 
is an exact equilibrium. Interestingly, although it is an ap¬ 
proximate algorithm, with 98%, the 4-OCSC Algorithm finds 
the value of an exact equilibrium, and not an e-equilibrium. 
This is not unexpected, as by part 4) of Proposition [3] already 
the value of a* = ^ « (which in our case equals to 0.13) 
implies that. It is important however to note that this result 
suggests that, for a big number of players, it is reasonable to 
use the proposed fast and simple algorithm instead of using 
a complicated, and not necessarily convergent algorithms like 



Fig. 2. The probability that a >= 1/(1 + 7 *). 



Fig. 3. a* depending on the number of iterations in Algorithm 4. 


the one of Meshkati et al. j6), as in a vast majority of cases 
it gives an exact equilibrium solution. 

We plot in Figure [3] the value of a* for the d-MCSC 
Algorithm as a function of iterations for a number of users 
N = 10. Obviously, the first value obtained in Fig. [3] is the 
one corresponding to the S- OCSC Algorithm. As expected, 
we observe that the value of a* increases as the number of 
iterations increases. Note however, that this increase does not 
usually imply the increase of energy efficiency as we will see 
next in Fig. [4] But, as we can see in Fig. [3] also in this case, 
for I\ = 12 carriers, we observe a significant increase of a* 
from the 6th iteration on, which can result in the <5-MCSC 
Algorithm outperforming the d-OC’SC Algorithm. 

Let us now illustrate the impact of such parameters on 
the system performances at the equilibrium. Figure [4] depicts 
the average energy efficiency when users implement the S- 
OCSC Algorithm and the 5-MCSC Algorithm for SNR = 10 
dB, where the average is done over the N users. For our 
comparison purpose, we exemplify our general analysis by 
investigating the following algorithms: 

• the random coordination algorithm : which uses a ran¬ 
dom permutation of users and then applies Algorithm 1, 

• the spectrum pooling algorithm : which is throughput- 
based-utility p4) , and 

• the optimal solution : obtained through exhaustive search. 
We vary the number of players from 2 ( i. e. , one leader and 
one follower) to 30 (i.e., one leader and 29 followers). We first 
observe that, for both S-OCSC and <5-MCSC algorithms, the 
energy efficiency increases with the number of users, which 
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Fig. 4. Average energy efficiency at the equilibrium for increasing number 
of users for SNR = 10 dB. 

is somewhat intuitive, as a bigger number of players means 
that more of them will be able to use their best carriers 
due to channel diversity gain. Another important result is 
that the two proposed algorithms perform very closely to 
the optimal solution, which offer hope that our algorithms 
perform reasonably well trying to make up for the decreasing 
carrier diversity by using the player diversity instead. Such 
a result is even more important, as the complexity of the 
two proposed algorithms is in the worst case quadratic in the 
number of users N, whereas the complexity of the exhaustive 
search is N\. Moreover, it is clearly shown that the <5-OCSC 
and (5-MCSC algorithms outperform the random coordination 
algorithm as already stated by Remark 1. Finally, we remark 
that the energy efficiency of the spectrum pooling algorithm 
decreases as the number of users increases which suggests that 
throughput-based-utility schemes are even less energy efficient 
as the number of users increases, because in such case, users 
have to transmit at higher power as the opportunity to transmit 
is lower. 

In Figure [5] we plot the average energy efficiency at the 
equilibrium depending on the SNR for N = 5 users. Again, we 
observe that the (5-OCSC and (5-MCSC algorithms outperform 
the random coordination algorithm, and the gap between the 
two proposed algorithms and the optimal solution is very small 
even when the SNR increases. Here, the (5-MCSC algorithm 
performs slightly better than the (5-MCSC algorithm. As the 
SNR decreases, all configurations tend towards having the 
same (zero) energy efficiency. This can be justified by the fact 
that, at low SNR regime, whatever the power control strategy 
each user chooses, the signal is overwhelmed by the noise. 

In order to figure out the balance between the achievable 
rate and energy consumption of the system, we plot in Fig. [6] 
the spectral efficiency as a function of the energy efficiency. 
Particularly noteworthy is the fact that the (5-OCSC and <5- 
MCSC algorithms optimize the energy efficiency while still 
maximizing the spectral efficiency, whereas the spectrum 
pooling scheme performs slightly better in terms of spectral 
efficiency, but is clearly energy inefficient with the respect 
to the other schemes. Moreover, the spectral efficiency at the 
equilibrium of the two proposed algorithms can be computed 



Fig. 5. Average energy efficiency at the equilibrium as a function of the 
SNR for TV = 5 users. 
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Fig. 6. Spectral efficiency - Energy efficiency trade-off. 

exactly: It is equal to log 2 (l + 7 *) — 2.9, with 7* = 6.47, 
which corresponds exactly to the spectral efficiency in Figure 
[6] Notice that this contrasts with most related works so far in 
which the optimal energy efficiency performance often leads 
to low spectral efficiency performance and vice versa (25)- 
(3§. This key features have a great impact on the network 
performance, and may further guide the design of power 
control strategies in a multi-carrier energy efficient systems. 

VI. Conclusion 

The potential spectral efficiency gain along with the re¬ 
duced computational complexity make spectrum coordination 
across multiple interfering users much more challenging than 
traditional setups built on strict interference avoidance. In 
this work, we have considered a hierarchical multiple access 
multi-carrier system in which users wish to selfishly maximize 
their energy efficiency by means of adequately choosing their 
power control policy over the carriers. A main challenge of 
applying the idea of hierarchical games in the energy efficient 
multi-carrier context is that, contrary to throughput-based- 
utility problems where only a certain number of carriers are 
exploited depending on the channel gains, energy efficient 
systems always leave K — 1 bands completely vacant for 
other users to be exploited. Following the above trend, we 
have explored a multi-level (hierarchical) energy efficient 
game framework where all players attempt to coordinate their 
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transmission (in terms of spectrum) and analyze how users 
behave in the presence of hierarchy. The proposed approach 
goes toward the vision of a fully coordinated multi-carrier 
energy efficient wireless network, whereby transmit powers 
are coordinated across the users. We have presented two 
intuitive, easy to implement and nearly-optimal algorithms 
which, in 98% of cases, converge to an exact equilibrium. 
Interestingly, our simulation results have shown that the two 
proposed algorithms achieve a flexible and desirable trade-off 
between energy efficiency and throughput maximization by 
exploiting the advantageous intrinsic features of the spectrum 
coordination paradigm. 
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Appendix 

A. Proof of Proposition [2] 

Proof: First note that when each of the players uses 
different carrier, player n choosing carrier k may at most 

fc 

obtain utility which is achieved by allocating power 

, * 2 

Pn = f t° this carrier. If at least two players allocate some 
power to the same carrier k, the utility of each of them can 
only decrease, thus the highest utility obtainable in the game 
for player n (if all others cooperate to maximize his utility) is 

g k n 

ma x k < K p. 

Now suppose that there exists a such that p T ( n )(n) > a for 
n = 1,,N. Then at step j of the 7T-CSC Algorithm user 
7 r(j) chooses one of the carriers that are not chosen yet. As 
there are only j — 1 carriers already chosen, he will choose 
one of j carriers, whose are the greatest. For each of 

them 

rtu) ^ P-0)O')max^ ( .) > amax^ (j) . 


The utility obtained by n(j) when he will allocate power 

, *2 

p , = nr- to such a k will thus be 

v(j) gi U) 


k k 

y~(j) 71 {'i) 

—> a max —- 1 . 
a 2 k<K a 2 


which is a times the biggest utility obtainable for player 7r(j) 
in the game. 


B. Proof of Proposition [j] 

Proof: First note that if Algorithm [2] does not give an 
output (a*,7r*) with 7r* 7 ^ 0, we can take a* = 0 and 7 r* = 
(1,2,..., N). This is because for a* = 0 every p n (l) will be 
bigger than a*. Thus any ordering of the players 7 r* will satisfy 
p^,(i) (l) > a* for every l = 1,..., N and by Proposition |2] 
and Corollaries [I] and [2] also statements 1), 2) and 3) of the 
proposition. 

Next, see also that Algorithm [2] is always terminated at 
some step, as after each passage through points 1 )—3) of the 
algorithm, a —a decreases twice, thus at most after log 2 (^ _1 ) 
passages, a — a < 6, which stops the algorithm. 

Now suppose that a* and 7 t* are nonzero outputs of 
Algorithm |2] Then for every l = 1 p n *(i)(l) > a*, 

as by construction of 7r*, for each l* chosen in the algorithm, 
a* < Pn+mi}*) < Pn*(i){l), where the last inequality is due to 
the facts that l < l* and that p n (l) are decreasing in l. Again, 
we can apply Proposition [2] and Corollaries |T] and [2] to obtain 
statements 1), 2) and 3) of the proposition also in this case. 

Now suppose that the first part of the (5-OCSC Algorithm 
(Algorithm |2j) was terminated by condition (a* =)a > r , 
and let (pi,p 2 , ■ ■ ■ ,Pn) be the power control vector chosen 
in the second part of the algorithm. We will show that these 
controls form an equilibrium in the game. Suppose they do 
not, that is - there exists a player n who can gain by deviating 
form it. First note that he will not deviate to any of the carriers 
that are not used by anyone, as 7 r*-CSC algorithm assures that 
player n always chooses his best available carrier at the time 
decision is made. Obviously the set of unoccupied carriers 
may only shrink afterwards, so any carrier that is idle upon 
the termination of the algorithm can only decrease the utility 
for player n. Thus suppose that player n changes his carrier 
to some carrier k*, used by some other player j using power 

p k * = By Proposition jlj (adapted to the iV-player case) 

the biggest utility for player n that can be obtained on that 
carrier will be for power 


This utility will be thus equal to 


Pn = 


7*(q 2 + g k p k ) 

9n 

7 *cr 2 (l + 7 *) 

9n 



Pn 7*CT 2 (1 + 7 *)' 

On the other hand the utility obtained by i on carrier re(n) 

q K ( n ) 

he currently uses is and by already proved part 1) of 

Proposition [3] not worse than 


a max 


> max 


> 


k<K 7*cr 2 fc<if 7*(1 + 7*)cr 2 “ 7*cr 2 (l + 7*) ’ 

which ends the proof of part 4) of the proposition. 

Finally let g% be defined by 

9n = Pn{k) maxg l n . 

Obviously g* give the same values of p n (k) as g Note also 
that, for each of the players, the biggest value of g* is for 
k = 1, the second biggest for k = 2 and so on. Thus, for such 

9n> 

Pn=Pn(k). (8) 

Obviously, for such values of g k n , each of the players will 
always be better off choosing one of the carriers 1, ...,jV 
than any other ones. Thus we can assume that in our problem 
N = K. Now suppose that, for some <5 > 0, there exists a 
power control in the game, inducing spectrum coordination 
and such that each of the players receives more than (a* + 

S ) maxfc<if . , which is a* + <5 times the biggest possible 
value of his utility (where a* is obtained in Algorithm [2] for 
<5). Let k*[n) be the carrier chosen by player n in that control. 
Since by 1) of Proposition [3] it could not be found by the 5- 
OCSC Algorithm, no ordering of the players 7r can be found 
such that 

Pir(n)(n) > a* + 5 ( 9 ) 

for every n = 1,..., N. Let us take 7r such that k*(Tr(n)) = 
n for n = 1,..., N (since K = N and we have spectmm 
coordination, this is well defined). Let i* denote i for which 
<0 is not satisfied. For such an i* we have 


fe*(7T (»*)) 


_ fc*(7T(i*)) 

Pn{i*) ’ 


maxKjf 

which by (|8]i equals 

Piv(i*)(k*(7t(i*))) = pn(i*)(i*) <a* + 6 

and thus there exists a player j = n(i*) such that 


9 3 


< ( a* + S) max g k 


k<K 


which implies that his utility is 


(7) 


k* (j) 

9j 

7*<t 2 


< (a* + S) max 


9i 


k<K 7*<7 Z 


















contradicting the assumption that each of the players receives 

k 

more than (a* + S ) ma Xk<K ■ 



